Skip to content

add aws bedrock prompt-caching support #3213

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

xxxx3
Copy link

@xxxx3 xxxx3 commented May 16, 2025

add aws bedrock prompt-caching support.
aws url:https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html

@markpollack markpollack added this to the 1.1.x milestone May 17, 2025
@DEG-7
Copy link

DEG-7 commented May 30, 2025

Hey @xxxx3, could you also add the cachePoint in the tools definition as it's shown in the same AWS documentation page you shared?
Great work and thank in advance !!

...
toolConfig={
    "tools": [
        {
            "toolSpec": {
                "name": "top_song",
                "description": "Get the most popular song played on a radio station.",
                "inputSchema": {
                    "json": {
                        "type": "object",
                        "properties": {
                            "sign": {
                                "type": "string",
                                "description": "The call sign for the radio station for which you want the most popular song. Example calls signs are WZPZ and WKRP."
                            }
                        },
                        "required": [
                            "sign"
                        ]
                    }
                }
            }
        },
        {
                "cachePoint": {
                    "type": "default"
                }
        }
    ]
}
...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants